Information processing device, information processing method, and program

ABSTRACT

[Problem] An information processing device, information processing method, and program that can perform stable position detection even in an environment in which a detection wavelength is included in external light are provided. [Solution] An information processing device including: a control unit that performs position detection of an object, on which a light emitting unit or a reflective material is provided, on the basis of a captured image acquired by imaging of emitted light or reflected light of the object in a direction facing a side, on which the light emitting unit or the reflective material is provided, of the object, wherein the control unit adjusts algorithm for the position detection of the object according to an illuminance detection result of external light including at least a wavelength of the emitted light or the reflected light.

FIELD

The present disclosure relates to an information processing device, aninformation processing method, and a program.

BACKGROUND

Conventionally, a method of detecting a position by using emitted lightthat has a specific wavelength and that is, for example, infrared lighthas been introduced into a pen input device or the like.

For example, in Patent Literature 1 below, it is disclosed that a lightreflection-type indicator that is smaller and lighter than a light penis used in a coordinate input system that provides a coordinate inputfunction on a transmission-type screen for an image display which screenis of a rear projection display device or the like.

CITATION LIST Patent Literature

Patent Literature 1: JP 11-224160 A

SUMMARY Technical Problem

However, in an environment having a detection wavelength of externallight or the like, there is case where it is difficult to distinguishambient light and a position of a detection object.

Thus, the present disclosure proposes an information processing device,an information processing method, and a program that can perform stableposition detection even in an environment in which a detectionwavelength is included in external light.

Solution to Problem

According to the present disclosure, an information processing device isprovided that includes: a control unit that performs position detectionof an object, on which a light emitting unit or a reflective material isprovided, on the basis of a captured image acquired by imaging ofemitted light or reflected light of the object in a direction facing aside, on which the light emitting unit or the reflective material isprovided, of the object, wherein the control unit adjusts algorithm forthe position detection of the object according to an illuminancedetection result of external light including at least a wavelength ofthe emitted light or the reflected light.

According to the present disclosure, an information processing method isprovided that includes: performing position detection of an object, onwhich a light emitting unit or a reflective material is provided, on thebasis of a captured image acquired by imaging of emitted light orreflected light of the object in a direction facing a side, on which thelight emitting unit or the reflective material is provided, of theobject; and, adjusting algorithm for the position detection of theobject according to an illuminance detection result of external lightincluding at least a wavelength of the emitted light or the reflectedlight, performing position detection and adjusting algorithm beingperformed by a processor.

According to the present disclosure, a program is provided that causes acomputer to function as a control unit that performs position detectionof an object, on which a light emitting unit or a reflective material isprovided, on the basis of a captured image acquired by imaging ofemitted light or reflected light of the object in a direction facing aside, on which the light emitting unit or the reflective material isprovided, of the object, wherein the control unit adjusts algorithm forthe position detection of the object according to an illuminancedetection result of external light including at least a wavelength ofthe emitted light or the reflected light.

Advantageous Effects of Invention

As described above, according to the present disclosure, it becomespossible to perform stable position detection even in an environment inwhich a detection wavelength is included in external light.

Note that the above effect is not necessarily limitative. In addition toor instead of the above effect, any of effects described in the presentdescription or a different effect that may be grasped from the presentdescription may be acquired.

BRIEF DESCRIPTION OF DRAWINGS

FIG. 1 is a view for describing an outline of an information processingsystem according to an embodiment of the present disclosure.

FIG. 2 is a view for describing an arrangement configuration of a casewhere the information processing system according to the presentdisclosure is adopted to air hockey.

FIG. 3 is a block diagram illustrating an example of a configuration ofan information processing device according to the present embodiment.

FIG. 4 is a view for describing an example of position detectionalgorithm based on a bright spot according to the present embodiment.

FIG. 5 is a view for describing an example of position detectionalgorithm based on a positional relationship between a shadow and abright spot according to the present embodiment.

FIG. 6 is a view for describing a case where different kinds of positiondetection algorithm are respectively used for regions according to thepresent embodiment.

FIG. 7 is a flowchart illustrating an example of a flow of positiondetection processing according to the present embodiment.

FIG. 8 is a view for describing an example of applying the informationprocessing system according to the present embodiment is applied tosport climbing.

FIG. 9 is a view for describing an example of applying the informationprocessing system according to the present embodiment to a livingenvironment.

FIG. 10 is a view illustrating an example of a captured image acquiredfrom each camera in an arrangement configuration illustrated in FIG. 9.

FIG. 11 is a view for describing a case where an arrangement of anobject is placed in a shadow of an installation object in an applicationexample to the living environment illustrated in FIG. 9.

FIG. 12 is a view illustrating an example of a captured image acquiredfrom the imaging device in the case illustrated in FIG. 11.

DESCRIPTION OF EMBODIMENTS

In the following, a preferred embodiment of the present disclosure willbe described in detail with reference to the attached drawings. Notethat, in the present description and the drawings, the same referencesigns are assigned to components having substantially identicalfunctional configurations, and an overlapped description thereof isomitted.

Also, a description will be made in the following order.

1. Outline of information processing system according to one embodimentof the present disclosure

2. Configuration example of information processing device

3. Operation processing

4. Application example

4-1. Example of adaptation to sport climbing

4-2. Example of adaptation to home use

4-3. Other

5. Conclusion

1. OUTLINE OF INFORMATION PROCESSING SYSTEM ACCORDING TO ONE EMBODIMENTOF THE PRESENT DISCLOSURE

FIG. 1 is a view for describing an outline of an information processingsystem according to an embodiment of the present disclosure. Asillustrated in FIG. 1, the information processing system 1 according tothe present embodiment includes an external sensor 20 that measures asurrounding environment, an information processing device 10 thatdetects a position of an object 40 on which a light emitting element 42is provided, and an imaging device 30 that images the object 40 from aside on which the light emitting element 42 is provided.

The information processing device 10 detects a position of the object 40on the basis of a captured image captured by the imaging device 30.

Here, in an environment including a detection wavelength of externallight or the like, there is a case where it is difficult to distinguishambient light and a position of a detection object. That is, in a casewhere a method of detecting a position of an object by detecting abright spot of a light emitting element, which is provided on theobject, from a captured image acquired by imaging of the light emittingelement is used, when illuminance of external light having an emissionwavelength (detection wavelength) of the light emitting element is high,the illuminance of the external light in the surrounding is detectedsufficiently higher than illuminance of the bright spot, and it isdifficult to detect the bright spot or to determine the position of thedetection object.

Thus, as illustrated in FIG. 1, in the present embodiment, the lightemitting element 42 is provided on a part of a bottom surface(preferably, position not grounded on an outline of the bottom surface)of the object 40, the imaging device 30 is arranged in such a mannerthat imaging is performed from a lower side through a plate-like member50 on which the object 40 is placed, that is, in a direction facing thebottom surface on which the light emitting element 42 is provided, and acaptured image is acquired. Then, a position of the object 40 isdetected from the captured image. Here, the information processingdevice 10 makes it possible to perform stable position detection even inan environment in which a detection wavelength is included in externallight by adjusting algorithm used in detection of a position of theobject 40 according to an external light environment detected by theexternal sensor 20.

Note that the object 40 illustrated in FIG. 1 may be fixed, or aposition thereof may be changed by a user or an independent operation.The light emitting element 42 provided on the object 40 is to emit lightof a specific wavelength, and may be what emits light by itself, such asan LED or organic EL, or may be a reflective material that reflects adifferent light source and that is, for example, a recursive material ora mirror including fine particles or prisms. Also, there may be one or aplurality of light emitting elements 42 on the object 40. Also, thelight emitting element 42 may be arranged by combination of elementshaving different light emitting properties. A housing that forms theobject 40 may be for fixation of a light emitting element or for adifferent function.

The external sensor 20 is used to grasp a surrounding environment of theobject 40 and the imaging device 30, specifically, an illuminanceenvironment that affects detection of the object 40. The external sensor20 is realized by a camera that acquires an image at a specificwavelength, or an illuminance sensor. One or a plurality of wavelengthsmay be acquired. Also, there may be one or a plurality of externalsensors 20. Note that the imaging device 30 may also have a function ofthe external sensor 20.

The plate-like member 50 on which the object 40 is placed is a memberthat transmits the emission wavelength of the light emitting element 42.Also, the plate-like member 50 is placed between the object 40 and theimaging device 30.

As described above, the information processing device 10 detects theposition of the object 40 on the basis of the captured image from theimaging device 30. Specifically, the information processing device 10may adjust algorithm used for position detection on the basis of adetection result from the external sensor 20. More specifically, theinformation processing device 10 switches position detection algorithmto be used or changes a parameter used in position detection algorithmto be used, for example, according to an external light illuminanceenvironment with respect to light emission intensity of the lightemitting element 42.

In the above, an information processing system according to oneembodiment of the present disclosure has been described. Next, aconfiguration and operation processing of the information processingsystem according to the present embodiment will be described in detail.In the present embodiment, an example of adaptation to air hockey willbe described as an example.

FIG. 2 is a view for describing an arrangement configuration of a casewhere the information processing system 1 according to the presentdisclosure is adopted to air hockey. The air hockey is a game in which auser grips a tool called a mallet (hereinafter, mallet 401) and hits adisk that is made of plastic or the like and is called a puck(hereinafter, puck 431) on a board, the puck 431 being levitated by theair blasted onto a board surface. As illustrated in FIG. 2, in a casewhere a plurality of users plays a match, the users (user A and user B)respectively grip and operate a mallet 401A and a mallet 401B, and hitthe puck 431.

Also, in the present embodiment, a mallet 401 gripped by each usercorresponds to the object 40, and a light emitting element 421 isinstalled on a bottom surface part of the mallet 401, as illustrated inFIG. 2. In the present embodiment, for example, an infrared (IR) LED isused as the light emitting element 421. Here, a board surface 501includes a material that does not transmit a visible light region andthat transmits an IR (such as white polymethyl methacrylate (PMMA) orcloth). This makes it possible to prevent the user from visuallyrecognizing installation jigs such as a detection camera (imaging device30) and to prevent a damage in an appearance of an air hockey gamedevice. Also, since the board surface 501 does not transmit visiblelight, it becomes possible to project a video or the like on the boardsurface 501 by a projector 52. The information processing device 10 canarbitrarily project a video or the like on the board surface 501 by theprojector 52 according to positional information of the mallet 401detected by the present system.

Also, on a lower side of the board surface 501 on which the mallet 401is placed, an angle of view of the imaging device 30 installed in such amanner as to face the board surface 501 is preferably an angle of viewwith which the entire board surface 501 can be photographed. Also, inthe imaging device 30, a photographing wavelength may be limited by abandpass filter or the like that detects only an emission wavelength ofthe light emitting element 421.

Next, a detailed configuration of the information processing device 10according to the present embodiment will be described.

2. CONFIGURATION EXAMPLE OF INFORMATION PROCESSING DEVICE 10

FIG. 3 is a block diagram illustrating an example of a configuration ofthe information processing device 10 according to the presentembodiment. As illustrated in FIG. 3, the information processing device10 includes a control unit 100, a communication unit 110, an operationinput unit 120, a display unit 130, and a storage unit 140.

The control unit 100 functions as an arithmetic processing device and acontrol device, and controls overall operation in the informationprocessing device 10 according to various kinds of programs. The controlunit 100 is realized by an electronic circuit such as a centralprocessing unit (CPU) or a microprocessor, for example. Also, thecontrol unit 100 may include a read only memory (ROM) that stores aprogram, a calculation parameter, or the like to be used, and a randomaccess memory (RAM) that temporarily stores a parameter or the like thatchanges as appropriate.

Also, the control unit 100 according to the present embodiment alsofunctions as a position detection unit 101 and a position detectionalgorithm adjustment unit 102.

On the basis of the captured image acquired by the imaging device 30,the position detection unit 101 detects a position of the mallet 401 byusing position detection algorithm adjusted by the position detectionalgorithm adjustment unit 102.

The position detection algorithm adjustment unit 102 adjusts theposition detection algorithm on the basis of an external lightilluminance detection result from the external sensor 20. As for theadjustment of the position detection algorithm, switching of a pluralityof kinds of position detection algorithm and changing a parameter in theposition detection algorithm are assumed.

Here, switching of a plurality of kinds of position detection algorithmaccording to the external light illuminance detection result will bedescribed.

First, algorithm used in a case where external light illuminance issufficiently lower than luminance (illuminance) of the light emittingelement 421 will be described as first position detection algorithm.

In the present embodiment, the “external light illuminance” meansilluminance of a wavelength (being detection wavelength andcorresponding to an emission wavelength of the light emitting element421) detected by the imaging device 30. For example, a case where thereis no light, a case where lights do not include infrared rays, and thelike are assumed as examples of a case where the external lightilluminance is sufficiently low. In this case, since the external lightilluminance is sufficiently low, a bright spot of an IR LED (lightemitting element 421) has the highest luminance in the captured imageacquired by the imaging device 30.

The position detection algorithm adjustment unit 102 may determine thatthe external light illuminance is sufficiently low in a case where theexternal light illuminance is lower than a predetermined threshold setaccording to the luminance of the light emitting element 421, forexample.

In this case, for example, as illustrated in FIG. 4, the captured imageacquired by the imaging device 30 becomes a captured image 60 from whichbright spots 601 and 602 respectively corresponding to the mallets 401Aand 401B can be detected. Thus, the position detection unit 101 candetect the bright spots 601 and 602 having high luminance and cancalculate positions of the mallets 401A and 401B according to positionsof the detected bright spots.

Note that the detection of an illuminance environment is not limited tobe by the external sensor 20, and determination can be also made fromthe captured image acquired by the imaging device 30 (that is, theimaging device 30 also functions as the external sensor 20). Forexample, in a case where a bright spot having a predetermined size canbe detected from the captured image acquired by the imaging device 30(it is assumed that a size of a bright spot corresponding to the lightemitting element 421 is already known), the position detection algorithmadjustment unit 102 determines that the external light illuminance issufficiently lower than the luminance (illuminance) of the lightemitting element 421, and selects the first position detectionalgorithm.

Next, algorithm used in a case where external light illuminance ishigher than luminance (illuminance) of the light emitting element 421will be described as a second position detection algorithm.

As an example of a case where the external light illuminance is higherthan the luminance of the light emitting element 421, for example, acase of an environment in which sunlight is directly radiated or alighting environment of a mercury lamp or the like in which environmentinfrared rays are generated is assumed. In this case, since the externallight illuminance is sufficiently high, the illuminance due to theexternal light is detected sufficiently higher than the illuminance ofthe bright spot of the IR LED (light emitting element 421) in thecaptured image acquired by the imaging device 30, and bright spotdetection cannot be performed by the first algorithm. Note that theposition detection algorithm adjustment unit 102 may determine that theexternal light illuminance is higher than the luminance of the lightemitting element 421, for example, in a case where the external lightilluminance exceeds a predetermined threshold set according to theluminance of the light emitting element 421.

In this case, the position detection algorithm adjustment unit 102selects, as second position detection algorithm, a means of determininga position of a mallet 401 (object) by combining an area having lowluminance (part shaded by the mallet 401) and a position having highluminance therein (bright spot) on the basis of luminance informationacquired from the captured image. Specifically, for example, asillustrated in FIG. 5, in a case where a positional relationship thatbright spots 601 and 602 are placed in shadow regions 611 and 612 isacquired in the captured image 61, it is determined that the brightspots 601 and 602 correspond to the mallets 401A and 401B and it becomespossible to perform position calculation of the mallets 401A and 401B.Also, a position of a shadow region having a shape of a mallet 401 maybe detected and the position may be directly output as a position of themallet 401. The captured image 61 having a shadow of such a mallet 401is acquired when the imaging device 30 images the mallet 401 in adirection facing a surface on which the light emitting element 421 isprovided.

In the above, a plurality of kinds of position detection algorithm andselection thereof have been described.

Note that a case where external light illuminance is not uniform in anarea (in detection range by the imaging device 30) is also assumed. Forexample, a case where external light does not reach a part of the regiondue to eaves or the like can be considered. Thus, on the basis of theluminance information of the captured image, the position detectionalgorithm adjustment unit 102 may respectively select different kinds ofposition detection algorithm for regions having different luminance inthe captured image acquired by the imaging device 30. For example, asillustrated in FIG. 6, in a case where a first region 621 havingluminance lower than a predetermined value and a second region 623having luminance higher than the predetermined value are detected fromthe captured image 62, the position detection algorithm adjustment unit102 may set to use the first position detection algorithm for the firstregion 621 since a position thereof can be detected only on the basis ofthe bright spot 622, and to use the second position detection algorithmfor the second region 623 since a position thereof can be detected onthe basis of a positional relationship between a shadow region 624 and abright spot 625. In such a manner, position detection algorithms can beselected for each area according to an illuminance condition in thepresent embodiment.

Furthermore, as an adjustment of position detection algorithm accordingto an external light illuminance detection result, the positiondetection algorithm adjustment unit 102 according to the presentembodiment can change a parameter of predetermined position detectionalgorithm.

For example, in a situation in which the second position detectionalgorithm is constantly used, the position detection algorithmadjustment unit 102 may multiply a shadow position parameter used in thealgorithm by a weight coefficient corresponding to illuminance. As aresult, for example, when the illuminance is 0, a parameter of a shadowposition which parameter is multiplied by the illuminance also becomes0, and detection is based only on a bright spot position eventually.Also, as described above, in a case where external light illuminance isnot uniform in an area, regions having different luminance may be set onthe basis of luminance information of a captured image, and differentparameters may be respectively applied to regions in the captured imageacquired by the imaging device 30.

In the above, each function of the information processing device 10 hasbeen described. Note that the information processing device 10 mayperform control in such a manner as to generate a projection controlsignal to control projection of a predetermined video on the plate-likemember 50 on the basis of positional information of the mallet 401detected by the position detection unit 101, and to transmit the signalto the projector 52 through the communication unit 110.

(Communication Unit 110)

The communication unit 110 transmits and receives information to andfrom other devices. For example, the communication unit 110 receives adetection result of external light illuminance from the external sensor20, or receives captured image from the imaging device 30. Also, thecommunication unit 110 can transmit positional information detected bythe position detection unit 101 or a projection control signalcorresponding to the positional information to the projector 52.

The communication unit 110 is communicatively connected to anotherdevice through, for example, a wired/wireless local area network (LAN),Wi-Fi (registered trademark), Bluetooth (registered trademark), nearfield communication, a mobile communication network (long term evolution(LTE)), or 3rd generation mobile communication system (3G)).

(Operation Input Unit 120)

The operation input unit 120 receives an operating instruction from auser and outputs the operation content to the control unit 100. Theoperation input unit 120 may be a touch sensor, a pressure sensor, or aproximity sensor. Alternatively, the operation input unit 120 may be aphysical component such as a keyboard, a mouse, a button, a switch, anda lever.

(Display Unit 130)

The display unit 130 is a display device that outputs various displayscreens. For example, the display unit 130 may display perceptualposition information (including migration pathway) or a generatedtactile presentation signal. This display unit 130 may be a displaydevice such as a liquid-crystal display (LCD) or an organic electroluminescence (EL) display, for example.

(Storage Unit 140)

The storage unit 140 is realized by a read only memory (ROM) that storesa program, a calculation parameter, and the like to be used inprocessing by the control unit 100, and a random access memory (RAM)that temporarily stores a parameter or the like that changes asappropriate.

In the above, a configuration of the information processing device 10according to the present embodiment has been described in detail. Notethat the configuration of the information processing device 10 is notlimited to the example illustrated in FIG. 3. For example, theinformation processing device 10 may include a plurality of devices.Also, the information processing device 10 may further include a soundinput unit and a sound output unit.

Also, the information processing device 10 may be realized by a PC, asmartphone, a mobile phone terminal, a tablet terminal, a dedicatedterminal, or the like. In addition, at least a portion of the controlunit 100 of the information processing device 10 may be realized by aserver on a network.

3. OPERATION PROCESSING

Next, operation processing of the information processing systemaccording to the present embodiment will be described in detail withreference to FIG. 7. FIG. 7 is a flowchart illustrating an example of aflow of position detection processing according to the presentembodiment.

As illustrated in FIG. 7, first, the information processing device 10acquires a captured image from the imaging device 30 (Step S103).

Then, the information processing device 10 acquires external lightilluminance from the external sensor 20 (Step S106).

Then, the position detection algorithm adjustment unit 102 determineswhether the external light illuminance is equal to or higher than athreshold (Step S109).

Then, in a case where the external light illuminance is equal to orhigher than the threshold (Step S109/Yes), the information processingdevice 10 causes the position detection algorithm adjustment unit 102 toselect position detection algorithm based on a combination (positionalrelationship) of a bright spot position of the LED (light emittingelement 421) and a shadow position, and causes the position detectionunit 101 to detect a position of the mallet 401 by using the selectedposition detection algorithm (Step S112).

On the other hand, in a case where the external light illuminance is notequal to or higher than the threshold (Step S109/No), the informationprocessing device 10 causes the position detection algorithm adjustmentunit 102 to select position detection algorithm based only on a brightspot position of the LED (light emitting element 421), and causes theposition detection unit 101 to detect a position of the mallet 401 byusing the selected position detection algorithm (Step S115).

In the above, an example of the operation processing according to thepresent embodiment has been described. Note that the operationprocessing illustrated in FIG. 7 is an example, and the presentdisclosure is not limited to the example illustrated in FIG. 7. Forexample, the present disclosure is not limited to the order of the stepsillustrated in FIG. 7. At least some of the steps may be processed inparallel, or may be processed in reverse order. For example, theprocessing in Step S103 and the processing in Step S106 may be processedin parallel or in reverse order.

(Supplementary Notes)

In Step S109 described above, external light illuminance and a thresholdare compared with each other. However, such processing is mainly forevaluating a relationship between the external light illuminance andilluminance of the light emitting element 421. Here, as differentevaluation methods (determination criteria for selecting positiondetection algorithm), the following examples are also included.

-   -   Comparison between an estimated value and detected external        light illuminance, the estimated value being derived from a        current applied to the light emitting element 421 or a light        emitting property thereof    -   Evaluation of detected external light illuminance on the basis        of illuminance information of the light emitting element 421        which information is acquired at initial setting

Also, in a case where the imaging device 30 also has a function of theexternal sensor 20, the position detection algorithm adjustment unit 102may determine that the threshold is met or exceeded (external lightilluminance is higher than the threshold) (that is, select the secondposition detection algorithm) in a case where an observation area withhigh luminance is larger, in a captured image, than a size correspondingto the light emitting element 42. Also, the position detection algorithmadjustment unit 102 may determine that the threshold is met or exceeded(external light illuminance is higher than the threshold) (that is,select the second position detection algorithm) in a case where a shadowregion can be detected from a captured image on the basis of luminanceinformation acquired from the captured image.

Also, in a case where a different lighting device such as an IRprojector is provided outside, a shadow of the mallet 401 may be furtheremphasized by interlocking with the lighting device.

In addition, in a case where a material of a housing (mallet 401) towhich the IR LED (light emitting element 421) is attached is a materialthat transmits a detection wavelength, it is assumed that no shadow isgenerated by the housing. Thus, a component having a material that doesnot transmit the detection wavelength may be attached in the housing.Alternatively, it is possible to perform position detection byperforming photographing by the imaging device 30 in a wavelength bodythat does not pass through the housing, and combining data of a shadowacquired from a captured image and a photographing wavelength(corresponding to bright spot position) at a detection wavelength (ofthe light emitting element 421).

4. APPLICATION EXAMPLE

An example of applying the information processing system 1 according tothe present embodiment to air hockey (information processing system 1 a)has been described above. However, the present embodiment is not limitedto this, and the following application examples are also possible, forexample.

(4-1. Example of Adaptation to Sport Climbing)

FIG. 8 is a view for describing an example of applying the informationprocessing system 1 according to the present embodiment to sportclimbing (information processing system 1 b).

As illustrated in FIG. 8, sport climbing is a game in which a playergrabs a protrusion (holds 701 to 703) attached to a wall 70 called awall and climbs. The information processing system 1 b detects aposition of a user (player) on the wall 70.

Specifically, a light emitting element 71 is attached to the user andused to detect limbs and the like of the user. One or more lightemitting elements 71 may be attached to a body of the user.

Also, the wall 70 has a property of transmitting a wavelength of thelight emitting element 71. Also, the wall 70 may be a porous material.

The imaging device 30 performs imaging from a back side of the wall 70on which the user climbs, that is, in a direction facing the userthrough the wall 70. Here, the body of the user corresponds to a housingof the mallet 401 in the information processing system 1 a, and a brightspot corresponding to the light emitting element 71 attached to the bodyof the user is placed in a shadow of the user in a case where the shadowof the user can be extracted from a captured image.

The position detection algorithm adjustment unit 102 selects the firstposition detection algorithm for performing position detection on thebasis of only the bright spot of the light emitting element 71 in a casewhere external light illuminance is sufficiently low (for example, in acase of being lower than a predetermined threshold), and selects thesecond position detection algorithm for combining a shadow of the userand a bright spot position of the light emitting element in a case wherethe external light illuminance is higher than the predeterminedthreshold.

Also, in a case where a skeletal frame of the user can be estimated fromshadow information of the user, the position detection unit 101 can alsoindividually identify the user according to an attachment position ofthe light emitting element 71 to the user.

Also, when the user is walking on a floor that transmits a wavelength ofthe light emitting element, it is possible to provide a light emittingelement on a sole of a foot or a sole of a shoe and to perform positiondetection of a person by detection from a back side.

(4-2. Example of Adaptation to Home Use)

Next, an example of adaptation to a living environment will be describedwith reference to FIG. 9 to FIG. 12.

FIG. 9 is a view for describing an example of applying the informationprocessing system 1 according to the present embodiment to a livingenvironment (information processing system 1 c).

In the example illustrated in FIG. 9, in a living environment, aplurality of detection cameras (imaging devices 30A to 30C) is installedin order to detect an object 80 (object or person) on which a pluralityof IR LEDs (light emitting elements 801 and 802) are mounted. It ispreferable to use a plurality of detection cameras since it is assumedthat the living environment is likely to have many blind spots comparedto the above-described examples of air hockey and sport climbing. Also,since photographing is performed from multiple directions by theplurality of detection cameras, it is preferable that a plurality of IRLEDs (light emitting elements) is mounted on the object 80.

Note that unlike the examples described above, each of the imagingdevices 30A to 30C performs imaging in a direction facing the object 80without a member or the like placed therebetween in the presentembodiment.

In a case where the object 80 is sufficiently exposed to the externallight in the arrangement configuration as illustrated in FIG. 9, theobject 80 can be imaged by the imaging device 30A and the imaging device30B. Here, an example of captured images acquired from the imagingdevice 30A and the imaging device 30B is illustrated in FIG. 10. Acaptured image 820 illustrated in FIG. 10 is an image acquired from anangle of view of the imaging device 30A illustrated in FIG. 9, and acaptured image 830 is an image acquired from an angle of view of theimaging device 30B.

At the angle of view of the imaging device 30B, since the external lightis stronger than luminance of the light emitting elements 801 and 802,bright spots of the light emitting elements 801 and 802 cannot bedetected as illustrated in the captured image 830. Also, due to arelationship between the object 80, the imaging device 30B, and anincident direction of the external light which relationship isillustrated in FIG. 9, no shadow of the object 80 is generated in thecaptured image 830.

On the other hand, at the angle of view of the imaging device 30A, evenin a case where the external light is stronger than the luminance of thelight emitting elements 801 and 802, a shadow of the object 80 isgenerated in the captured image 830. Thus, the information processingdevice 10 can perform position detection according to a combination(positional relationship) of the shadow and a bright spot by using thesecond position detection algorithm.

Also, as illustrated in FIG. 11, when the object 80 is placed in ashadow of an installation object such as a table, a captured image 840as illustrated in FIG. 12 may be acquired from the imaging device 30C.In this case, the information processing device 10 can perform positiondetection by detecting only a bright spot by using the first positiondetection algorithm.

As described above, according to an environment such as an incidentdirection of external light (specified from a position of a window 81,for example), a position of each imaging device 30, and a position of aninstallation object in addition to external light illuminance, theinformation processing device 10 can arbitrarily select positiondetection algorithm and perform stable position detection.

(4-3. Other)

The information processing system 1 according to the present disclosurehas been described in the above.

Note that the information processing system 1 according to the presentdisclosure is not limited to the above-described example, and theinformation processing device 10 may perform individual recognition ofeach object according to a shape of a shadow of the object, for example.

Also, the information processing device 10 may perform individualrecognition of each object according to a shape, the number, anarrangement, and the like of bright spots.

Alternatively, visible light may be used as a detection wavelength.

5. CONCLUSION

As described above, in an information processing system according to anembodiment of the present disclosure, it is possible to perform stableposition detection even in an environment in which a detectionwavelength is included in external light.

Also, by identifying a shape of a shadow, it is possible to identify aplurality of objects individually.

Also, in a case where detection is performed through a plate-like member50 that transmits an emission wavelength of a light emitting element 42,the light emitting element 42 is provided on a bottom surface of anobject 40 placed on the plate-like member 50, and the detection isperformed from a back side of a detection area through the plate-likemember 50, whereby detection without occlusion becomes possible.

Although a preferred embodiment of the present disclosure has beendescribed in detail in the above with reference to the attacheddrawings, the present technology is not limited to this example. It isobvious that a person with an ordinary skill in a technological field ofthe present disclosure can conceive of various modification examples orcorrection examples within the scope of the technical ideas described inclaims, and it should be understood that these also naturally belong tothe technical scope of the present disclosure.

For example, a computer program for causing hardware such as a CPU, aROM, and a RAM built in the information processing device 10 to exert afunction of the information processing device 10 can be created. Also, acomputer-readable storage medium storing the computer program is alsoprovided.

In addition, the effects described in the present description are merelyillustrative or exemplary, and are not limitative. That is, thetechnology according to the present disclosure can exhibit, along withor instead of the above effects, other effects apparent to those skilledin the art from the description herein.

Note that the present technology can also have the followingconfigurations.

(1)

An information processing device comprising:

a control unit that performs position detection of an object, on which alight emitting unit or a reflective material is provided, on the basisof a captured image acquired by imaging of emitted light or reflectedlight of the object in a direction facing a side, on which the lightemitting unit or the reflective material is provided, of the object,wherein

the control unit adjusts algorithm for the position detection of theobject according to an illuminance detection result of external lightincluding at least a wavelength of the emitted light or the reflectedlight.

(2)

The information processing device according to (1), wherein the controlunit switches, as an adjustment of the algorithm, a plurality of kindsof algorithm according to the illuminance detection result.

(3)

The information processing device according to (2), wherein theplurality of kinds of algorithm includes first position detectionalgorithm based on a position of a bright spot detected from thecaptured image.

(4)

The information processing device according to (3), wherein theplurality of kinds of algorithm includes second position detectionalgorithm based on a position of a bright spot with respect to a shadowregion detected from the captured image.

(5)

The information processing device according to (4), wherein the secondposition detection algorithm is algorithm for estimating that the brightspot is a position of the object in a case where the bright spot isplaced inside the shadow region.

(6)

The information processing device according to (4) or (5), wherein

the control unit

uses the first position detection algorithm in a case where theilluminance detection result does not exceed a predetermined threshold,and

uses the second position detection algorithm in a case where theilluminance detection result exceeds the predetermined threshold.

(7)

The information processing device according to (4) or (5), wherein

the control unit uses the first position detection algorithm withrespect to a region in which the illuminance detection result is lowerthan a predetermined value, and uses the second position detectionalgorithm with respect to a region in which the illuminance detectionresult is higher than the predetermined value in the captured image.

(8)

The information processing device according to any one of (1) to (7),wherein

the information processing device acquires the illuminance detectionresult of the external light from an external light illuminance sensor.

(9)

The information processing device according to (4) or (5), wherein theilluminance detection result of the external light is acquired from thecaptured image.

(10)

The information processing device according to (9), wherein

the control unit uses the second position detection algorithm in a casewhere a region having luminance that exceeds a predetermined thresholdin the captured image is equal to or larger than a predetermined sizecorresponding to the light emitting unit or the reflective material.

(11)

The information processing device according to (9), wherein

the control unit uses the second position detection algorithm in a casewhere a predetermined shadow region can be detected on the basis ofluminance information extracted from the captured image.

(12)

The information processing device according to (1), wherein

the control unit changes, as an adjustment of the algorithm, a parameterused in the algorithm according to the illuminance detection result.

(13)

The information processing device according to any one of (1) to (12),wherein the captured image is an image captured from a side, on whichthe light emitting unit or the reflective material is provided, of theobject through a member that transmits a wavelength of the emitted lightor the reflected light.

(14)

An information processing method comprising:

performing position detection of an object, on which a light emittingunit or a reflective material is provided, on the basis of a capturedimage acquired by imaging of emitted light or reflected light of theobject in a direction facing a side, on which the light emitting unit orthe reflective material is provided, of the object; and,

adjusting algorithm for the position detection of the object accordingto an illuminance detection result of external light including at leasta wavelength of the emitted light or the reflected light,

performing position detection and adjusting algorithm being performed bya processor.

(15)

A program causing a computer to

function as a control unit that performs position detection of anobject, on which a light emitting unit or a reflective material isprovided, on the basis of a captured image acquired by imaging ofemitted light or reflected light of the object in a direction facing aside, on which the light emitting unit or the reflective material isprovided, of the object, wherein

the control unit adjusts algorithm for the position detection of theobject according to an illuminance detection result of external lightincluding at least a wavelength of the emitted light or the reflectedlight.

REFERENCE SIGNS LIST

-   -   1, 1 a, 1 b, 1 c INFORMATION PROCESSING SYSTEM    -   10 INFORMATION PROCESSING DEVICE    -   100 CONTROL UNIT    -   101 POSITION DETECTION UNIT    -   102 POSITION DETECTION ALGORITHM ADJUSTMENT UNIT    -   110 COMMUNICATION UNIT    -   120 OPERATION INPUT UNIT    -   130 DISPLAY UNIT    -   140 STORAGE UNIT    -   20 EXTERNAL SENSOR    -   30 IMAGING DEVICE    -   30A IMAGING DEVICE    -   30B IMAGING DEVICE    -   30C IMAGING DEVICE    -   40 OBJECT    -   42 LIGHT EMITTING ELEMENT    -   50 PLATE-LIKE MEMBER    -   52 PROJECTOR    -   60, 61, 62 CAPTURED IMAGE    -   70 WALL    -   71 LIGHT EMITTING ELEMENT    -   80 OBJECT    -   401, 401A, 401B MALLET    -   421 LIGHT EMITTING ELEMENT    -   431 PUCK    -   501 BOARD SURFACE    -   601, 602 BRIGHT SPOT    -   611, 612 SHADOW REGION    -   622, 625 BRIGHT SPOT    -   624 SHADOW REGION    -   801, 802 LIGHT EMITTING ELEMENT    -   820, 830, 840 CAPTURED IMAGE

1. An information processing device comprising: a control unit thatperforms position detection of an object, on which a light emitting unitor a reflective material is provided, on the basis of a captured imageacquired by imaging of emitted light or reflected light of the object ina direction facing a side, on which the light emitting unit or thereflective material is provided, of the object, wherein the control unitadjusts algorithm for the position detection of the object according toan illuminance detection result of external light including at least awavelength of the emitted light or the reflected light.
 2. Theinformation processing device according to claim 1, wherein the controlunit switches, as an adjustment of the algorithm, a plurality of kindsof algorithm according to the illuminance detection result.
 3. Theinformation processing device according to claim 2, wherein theplurality of kinds of algorithm includes first position detectionalgorithm based on a position of a bright spot detected from thecaptured image.
 4. The information processing device according to claim3, wherein the plurality of kinds of algorithm includes second positiondetection algorithm based on a position of a bright spot with respect toa shadow region detected from the captured image.
 5. The informationprocessing device according to claim 4, wherein the second positiondetection algorithm is algorithm for estimating that the bright spot isa position of the object in a case where the bright spot is placedinside the shadow region.
 6. The information processing device accordingto claim 4, wherein the control unit uses the first position detectionalgorithm in a case where the illuminance detection result does notexceed a predetermined threshold, and uses the second position detectionalgorithm in a case where the illuminance detection result exceeds thepredetermined threshold.
 7. The information processing device accordingto claim 4, wherein the control unit uses the first position detectionalgorithm with respect to a region in which the illuminance detectionresult is lower than a predetermined value, and uses the second positiondetection algorithm with respect to a region in which the illuminancedetection result is higher than the predetermined value in the capturedimage.
 8. The information processing device according to claim 1,wherein the information processing device acquires the illuminancedetection result of the external light from an external lightilluminance sensor.
 9. The information processing device according toclaim 4, wherein the illuminance detection result of the external lightis acquired from the captured image.
 10. The information processingdevice according to claim 9, wherein the control unit uses the secondposition detection algorithm in a case where a region having luminancethat exceeds a predetermined threshold in the captured image is equal toor larger than a predetermined size corresponding to the light emittingunit or the reflective material.
 11. The information processing deviceaccording to claim 9, wherein the control unit uses the second positiondetection algorithm in a case where a predetermined shadow region can bedetected on the basis of luminance information extracted from thecaptured image.
 12. The information processing device according to claim1, wherein the control unit changes, as an adjustment of the algorithm,a parameter used in the algorithm according to the illuminance detectionresult.
 13. The information processing device according to claim 1,wherein the captured image is an image captured from a side, on whichthe light emitting unit or the reflective material is provided, of theobject through a member that transmits a wavelength of the emitted lightor the reflected light.
 14. An information processing method comprising:performing position detection of an object, on which a light emittingunit or a reflective material is provided, on the basis of a capturedimage acquired by imaging of emitted light or reflected light of theobject in a direction facing a side, on which the light emitting unit orthe reflective material is provided, of the object; and, adjustingalgorithm for the position detection of the object according to anilluminance detection result of external light including at least awavelength of the emitted light or the reflected light, performingposition detection and adjusting algorithm being performed by aprocessor.
 15. A program causing a computer to function as a controlunit that performs position detection of an object, on which a lightemitting unit or a reflective material is provided, on the basis of acaptured image acquired by imaging of emitted light or reflected lightof the object in a direction facing a side, on which the light emittingunit or the reflective material is provided, of the object, wherein thecontrol unit adjusts algorithm for the position detection of the objectaccording to an illuminance detection result of external light includingat least a wavelength of the emitted light or the reflected light.